Loading…
September 13 -14, 2017 - Los Angeles, CA
Click Here For Information & Registration
Back To Schedule
Friday, September 15 • 11:00am - 11:40am
Accelerating Spark Workloads in an Apache Mesos Environment with Alluxio - Adit Madan, Alluxio, Inc.

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Organizations Mesos and Apache Spark together to gain insight from large amounts of data. It is common for Spark to process data stored in disparate public cloud storage, such as Amazon S3, Microsoft Azure Blob Storage, or Google Cloud Storage as well as on-premise data on HDFS, Ceph or ECS. This architecture results in sub-optimal performance as data and compute are not co-located.

Using Alluxio, an open-source memory speed virtual distributed storage system, deployed on Mesos enables connecting any compute framework, such as Apache Spark, to storage systems via a unified namespace. Alluxio enables applications to interact with any data at memory speed. Alluxio can eliminate the pains of ETL and data duplication, and enable new workloads across all data. Adit will discuss the architecture of Mesos, Spark and Alluxio to achieve an optimal architecture for enterprises.
Speakers
avatar for Adit Madan

Adit Madan

Director of Product Management, Alluxio
Adit Madan has extensive experience in distributed systems, storage systems, and large-scale data analytics. Adit holds an MS from Carnegie Mellon University and a BS from the Indian Institute of Technology – Delhi. Adit is the Director of Product Management at Alluxio and is also... Read More →

MesosCon 2017 Alluxio pdf
Friday September 15, 2017 11:00am - 11:40am PDT
Diamond Salon 1 & 2
  SMACK-GPUs-Analytics

Attendees (20)